THE OPERAD OF WIRING DIAGRAMS: 
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Abstract. Wiring diagrams, as seen in digital circuits, can be nested hierarchi¬ 
cally and thus have an aspect of self-similarity. We show that wiring diagrams 
form the morphisms of an operad T, capturing this self-similarity. We discuss the 
algebra 7£el of mathematical relations on T, and in so doing use wiring diagrams 
as a graphical language with which to structure queries on relational databases. 
We give the example of circuit diagrams as a special case. We move on to show 
how plug-and-play devices and also recursion can be formulated in the operadic 
framework as well. Throughout we include many examples and figures. 
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1. Introduction 

In the classic book The Society of Mind [' ], Marvin Minsky proposes that the 

human mind is composed of a society of agencies, each of which is composed of 
a society of smaller agencies, and so on. While the lower-level agencies could not 
be considered intelligent, their composition into structured wholes yields behavior 
that is markedly intelligent. He argues that this self-similar or recursive structure 
emerges naturally and is efficient for processing information. In this paper we offer a 
mathematical framework for modeling self-similar information processing structures 
of a certain kind. 

In particular we will be interested in the self-similar nature of wiring diagrams, 
like those found in the design of digital circuits. One can wire together simple logic 
gates to form more complex ones, and wire these together to form still more complex 
circuits. Similarly, one may imagine that neurons can be wired together to form 
more complex information-processing centers in the brain, and that these can be 
wired together to form still more complex agencies. 

We will discuss the so-called wiring diagrams operad S , which models the notion of 
wiring smaller entities together to form larger ones. We will be careful to introduce 
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Figure 1. An entity composed of three smaller entities, all wired together. 


all the necessary operadic machinery, but it can be a bit dense for those who are 
unacquainted. For this reason, we will also draw plenty of pictures (such pictures 
constitute a large portion of the length of this document), which look like Figure 1. 

Operads were invented in the 1970s by [BV] and [Maj ]. We will recall the definition 
of operads in Definition 2.1.2, but it might be phrased in the current language using 
the slogan “a wiring diagram of wiring diagrams is a wiring diagram”. That is, if each 
little circle in Figure 1 is filled in with its own little wiring diagram, the result will 
be a big outer circle with tiny ones wired together inside. This will be spelled out in 
Example 2.1.7. 

Deciding what kind of object each circle represents (whether it be a digital circuit, 
an agency in the brain, a mathematical relation, etc.), and deciding how a wiring 
diagram such as that in Figure 1 produces a new such object from its constituent 
objects, is tantamount to choosing an algebra on the wiring diagrams operad. We 
will concentrate on the algebra 7£el of mathematical relations, in which an outer 
relation is built by applying a wiring diagram to a set of constituent relations. This 
algebra 7£el has immediate applications to visually representating relational database 
queries. 



But as the title of the paper suggests, one can also express recursion and so-called 
“plug-and-play”, or hot-plugging, in these terms. See Section 5. 
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Another reason for focusing on the algebra of relations is that digital circuits fall 
easily within this framework and provide a nice source of concrete examples. As a 
more abstract example, the algebra of relations can also serve as a crude model for 
agencies in the brain. We simply think of each agency as maintaining a relationship 
on its inputs. For example a person might be said to maintain a relationship between 
what she sees, hears, feels, and does; this can be represented as a 4-ary relation. 
Similarly, the visual cortex might be said to maintain relationships between the signals 
it receives from the eyes and from the rest of the brain. 

In [JS], it is shown that in the near future, cyber-physical systems will likely 
continue to blur the line between humans and the machines on which they work. One 
may imagine that the same hierarchical structures we use to conceive the human mind 
can be extended beyond the individual to encompass interactions between multiple 
humans and machines. Therefore, it is useful to have a single mathematical model, 
such as the operadic model presented throughout this paper, in which all such levels 
and layers can be discussed in a unified way. 

More broadly, we hope this paper will introduce operads to a more general audi¬ 
ence. The wiring diagrams operad discussed here is but a single possibility among 
many that may prove useful. Whenever one wants to discuss a situation in which 
structures are built out of other structures and the functionality follows suit, operads 
and their algebras may be employable. 

1.1. Related work. There are of course many books on digital circuits, e.g. [E ], 
and all that use wiring diagrams are related to the present paper, as we explain in 
Example 2.2.11. Another related concept is that of the propagator network ([RS]), 
in which computation is performed by a “network of autonomous but interconnected 
machines”. Clearly, the underlying idea behind our work and theirs is quite simi¬ 
lar: machines made of networked machines. This paper can be seen as providing a 
mathematical underpinning to this idea in terms of operads and their algebras. For 
example, no such distinction seems to be alluded to in the work of [RS]. 

Finally, there is a similarity between this work and previous work by the au¬ 
thor, including [Spl], [Sp2], and [Sp3]. All of these provide different conceptions of 
databases. The one that appears closest to the usual relational model is the present 
paper, whereas the one that is most aligned with basic category theory is [ 3]. The 

category-theoretic intersection between these viewpoints seems to be that databases 
are nicely modeled by sheaves in various guises. 

1.2. Layout of this paper. This paper will be structured as follows. In Section 
2, we will define most of the necessary operadic machinery and introduce our main 
operad of interest, the singly-typed wiring diagrams operad 5. We will also discuss 
our main algebras of interest, the relational 5-algebras He\ a- Examples in this section 
include digital circuits and the three queries in (2). Section 2 constitutes the heart of 
the paper; the rest of the paper amounts to variations and explorations of its theme. 

In Section 3 we discuss the notion of operad-theoretic invariants of the relational 
5-algebra. After proving that certain attempts to find such invariants come up short, 
we conjecture that there are no nontrivial invariants (see Conjecture 3.1.6). In Section 
4 we generalize the operad 5 to a typed version 7~ in which each wire carries values of 
a specific type. We show how all the relational 5-algebras TZelA extend to a single T- 
algebra 'R.el. In this section we more carefully discuss database queries (conjunctive 
and disjunctive), and compare to the wiring diagrams operad. In Section 5 we show 
that 5 and T are in fact closed operads, and we give applications to recursion (in 
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particular the factorial function) and the idea of plug-and-play devices. Finally, in 
Section 6 we discuss possibilities for future work. 

1.3. Acknowledgments. I’d like to thank my former UROP student Gaurav Singh, 
who was the first to write down a recursive function in terms of wiring diagrams. His 
diagram for the factorial function has a prominant role in this paper: see (18). I’d 
also like to thank Dave Balaban, A1 Jones, Emmy Murphy, Eswaran Subrahmanian, 
and especially Nat Stapleton for many useful and interesting conversations. 

2. Operads and wiring diagrams 

In this section we introduce operads, as well as our main operad of interest: the 
singly-typed wiring diagrams operad <S. We will also introduce algebras on an operad, 
as well as our main algebra of interest: the relational iS-algebra 7£el. 

We assume that the reader is familiar with basic category theory. Introductions to 
the subject include [Mac] and [Awo] for pure mathematicians, [BW] and [Pic] for com¬ 
puter scientists, and [Spl] for a general scientific audience. For those unacquainted 
with category theory, we hope that the diagrams will get across the basic idea. 
Notation 2.0.1. We denote the category of sets by Set and the full subcategory of 
finite sets by Fin c: Set. 

If n e N is a natural number, we write n e Set to denote the set n := {1,2,..., n}. 
We may also use symbols such as n to denote finite sets, e.g. n e Ob(Fin). Given 
a finite set n e Ob(Fin), we denote its cardinality by |n| e N. In other words, the 
following composite is the identity on N: 

N Ob(Fin) WI ~" H > N. 

For a set X, we let P(W) = (ffc X} denote its power set. We denote a one-element 
set by {*}. 

2.1. Operads. 

Warning 2.1.1. Throughout this paper, we use the word operad to mean what is 
generally called a symmetric colored operad or a symmetric multicategory. This ab¬ 
breviated nomenclature is not new, for example it is used in [Lur]. Hopefully no 
confusion will arise. For a full treatment of operads, multicategories, and how they 
fit into a larger mathematical context, see [Lei]. 

Definition 2.1.2. An operad O consists of some constituents (A. objects, B. mor- 
phisms, C. identities, D. compositions) conforming to some laws (1. identity law, 2. 
associativity law). The required constituents are as follows. 

A. There is a collection Ob((9), each element of which is called an object of O. 

B. For each object y e Ob(0), finite set n e Ob(Fin), and n-indexed set of 
objects x: n —* Ob(0), there is a set O n (x; y) e Ob(Set). Its elements are 
called morphisms from x to y in O. 

C. For every object x e Ob(0), there is a specified morphism denoted id K 6 
0\ (x\ x) called the identity morphism on x. 

D. Let s', m —* n be a morphism in Fin. Let £ e Ob(£>) be an object, let 
y: n —► Ob(0) be an n-indexed set of objects, and let x: m—> Ob(0) be an 
m-indexed set of objects. For each element i e n, write := s _1 (i) for the 
pre-image of s under i, and write x t = x\ mi : mi —*• Ob(0) for the restriction 
of x to mj. Then there is a function 

o: O n (y-,z ) x Y\O mi {xi',y{i)) — O m (x;z), 


(3) 
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called the composition formula. 

Given an n-indexed set of objects a :: n -*■ Ob(O) and an object y e Ob(0), we some¬ 
times abuse notation and denote the set of morphisms from x to y by 0(x i,..., x n : y). 
1 We may write Homo(ii,..., x n ; y), in place of 0(xi ,..., x n : y), when convenient. 
We can denote a morphism <j> e O n (x: y) by <p: x —► y or by </>: {x \,..., x n ) —> y. we 
say that each Xi is a domain object of <t> and that y is the codomain object of <f>. We 
use infix notation for the composition formula, e.g. writing if o (^,..., <f n ). 

Here are the laws that govern the above constituents: 

1. for every x\,..., x n , y e Ob(£?) and every morphism <j>: (x \,..., x n ) —> y, we 
have 

cf o (id Xl ,..., id Xn ) = (f and id y o cf = (f>\ 

and; 

2. an appropriate associative law. 2 

Remark 2.1.3. In this remark we will discuss the abuse of notation in Definition 2.1.2 
and how it relates to an action of a symmetric group on each morphism set in our 
definition of operad. We follow the notation of Definition 2.1.2, especially following 
the use of subscripts in the composition formula. 

Suppose that O is an operad, z e Ob(O) is an object, y: n —> Ob(£>) is an n- 
indexed set of objects, and <p : y —* z is a morphism. If we linearly order n, enabling 
us to write (j>: (y(1),..., y(\n\)) —> z, then changing the linear ordering amounts to 
finding an isomorphism of finite sets cr: m -=* n, where m = |n|. Let x = y o a 
and for each i e n, note that m; = cr -1 ({i}} = {cr —1 (i)}, so #,• = x\ a -i(^ = y(i). 
Taking id Xi e O rrii (xi. y(i)) for each i e n, and using the identity law, we find that 
the composition formula induces a bijection O n (y;z) O rn (x: z), which we might 
denote by 

o-: 0(y(l),y(2), ..., y(n); z) s 0(y(a(l)),y(a[2)) > ..., y(a(n));z). 

In other words, there is an induced group action of Aut(n) on O n (x: z), where Aut(n) 
is the group of permutations of an n-element set. 

Throughout this paper, we will permit ourselves to abuse notation and speak of 
morphisms <f>: (xi,X2, ■ ■ ■ ,x n ) —> y for a natural number n 6 N, without mentioning 


Where are three abuses of notation when writing 0(x i ,... ,x n ;y), which we will fix one by one. 
First, it confuses the set n e Ob(Fin) with its cardinality \n\ e N. But rather than writing 
0(x i,..., x \ n \; y), it would be more consistent to write 0(x( 1),..., x(|n|); y), because we have as¬ 
signed subscripts another meaning in part D. But even this notation unfoundedly suggests that the 
set n has been endowed with a linear ordering, which it has not. This may be seen as a more serious 
abuse, but see Remark 2.1.3. 

2 Here is the associative law. Let m —> n —> p be composable morphisms in Fin. Let z e Ob (O) 
be an object, let y: p —* Ob(0), x: n —► Ob(0), and w: m —* Ob(O) respectively be a p-indexed, 
n-indexed, and m-indexed set of objects. For each i e p, write nj = i 1 (i) for the pre-image and 
Xi: n-i —> Ob(0) for the restriction. Similarly, for each ken write mj, = s _1 (fe) and Wk '■ mu ~* 
Ob(O); for each i e p, write mi = (t o s) 1 (i) and Wi t -: m —* Ob(0); for each j e w;, write 
mij := s _1 (j) and Wij : m%j —► Ob(0). Then the diagram below commutes: 
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the abuse inherent in choosing an order, so long as it is clear that permuting the 
order of indices would not change anything up to canonical isomorphism. 

Example 2.1.4. We define the operad of sets, denoted Sets, as follows. We put 
Ob(Sets) := Ob(Set). Given a natural number n e N and objects Xi,., X n , Y e 
Ob(Sets), we define 

Sets(W 1 ,X 2 ,...,X„;F) := Hom Set (Xi x X 2 x • • • x X n ,Y). 

For any X e Ob(Sets) the identity morphism idx: X —» X is the same identity as 
that in Set. 

The composition formula is as follows. Suppose given a set Z e Ob(Set), a nat¬ 
ural number n e N, sets Yi.... ,Y n e Ob(Set), and for each i natural numbers 
mi,... ,m n e N and sets X^i ,..., X hrn . e Ob(Set). Suppose furthermore that we 
have composable morphisms: a function g\ Y\ x • • • x Y n —» Z and for each i e n a 
function f,: X tl x ... x X^ mi —► Y t . We need a function X-\ -\ x X 1;2 x • • • x X n<mn —► Z, 
which we take to be the composite 

(Xi,i x • • • x Xi, mt ) x • • ■ x (X nA x • • • x X n>m J /lX "' x/ " > Y t x — xY n -*->Z. 
It is not hard to see that this composition formula is associative. 

Example 2.1.5. Let S be any category with finite products. Such categories include: 
the category Fin of finite sets, the category PrO of preorders, the category JLat 
of join-semilattices, the category Type of types in a programming language, the 
category Cat of small categories, etc. We then define an operad Ss with 

Ob(Ss) = Ob(S) and Ss n (X x ,..., X n : Y) = Hom s (Xi x • • • x X n , Y). 
The composition formula is similar to that discussed in Example 2.1.4. 

Example 2.1.6. The commutative operad £ has one object, say Ob(£) = {a}, and for 
each n e N it has a single n-ary morphism, £ n (l ,..., a; a) = {p n }- In fact £ can be 
viewed as a special case of Example 2.1.5 where S = 1 is the terminal category; i.e. 
£ = Is. We will see in Lemma 2.2.4 that £ is the terminal object in the category 
of operads. (Again, recall from Warning 2.1.1 that all of our operads are actually 
symmetric colored operads, and we are saying that £ is the terminal object in that 
category.) 

Example 2.1.7 (Main Operad Example). In this example we discuss the op¬ 
erad S of singly-typed wiring diagrams. The objects of S are simply finite sets, 
Ob(<S) = Ob(Fin). However, we refer to each object as a singly-typed star and we 
draw an object, say X := {a,b,c,d,ej e Ob(5), as follows: 



The order of the elements around the circle does not matter: X is just a set. Each 
element of X is called a wire of X. 
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Let Y e Ob(<S) be an object, let n e N be a natural number, and let Xy,..., X n e 
Ob(<S) be singly-typed stars. A morphism <j>: Xy,.... X n —*■ Y consists of a cospan, 
3 i.e. a finite set C e Ob(Fin) and functions 


Y 


Xi U • • • II Mm 

We refer to such a morphism as an singly-typed, wiring diagram (or a wiring diagram 
or even a WD, for short); we refer to the domain objects Xy,..., X n as the inner 
stars, the codomain object Y as the outer star, and the set C as the set of cables. 
For any wire y e Y with g(y) = c (respectively x e Xi with f{x) = c), we say that 
y (respectively x) is soldered onto cable c. Figure 6 should make all this quite a bit 
clearer. 

Given composable morphisms fa : Yj,..., Y n —* Z and fa,..., <p n , where each 
fa : X,y ,..., X i rrlj —» Yi, we can arrange their representing cospans in the form of the 
W-shaped diagram below. The composition formula is given by taking the pushout 
P of the middle square. 

(7) Z 

9' 

UienYi-^-^D 


LU„ U jEmi ^ Uicn c- - 

Here 0' o [cpy,.... 0 n ) is represented by the cospan I l ien II jemi Xij —» P <— Z. 

The composition formula for (f>' o (0y ,..., <p n ) is intuitive when drawing pictures. 
We begin with wiring diagrams 1 fa of little inner stars inside intermediary stars and 
a wiring diagram <j)' of intermediary stars inside a big outer star. The wires of the 
intermediary stars Y, will match interior cables to exterior cables. The composition 
is visualized by first placing the little WDs fa into their respective outer stars Y,, 
and then removing the intermediary circles Yj, while preserving the connections they 


3 In fact, a morphism <f>: (Xy,... ,X n ) — » Y in S is defined to be a cospan up to isomorphism. In 
other words, given a commutative diagram as below, 


a 



Xy II ■ ■ ■ II X n at Y 



we say that the cospans (/, g) and (/', g') represent the same morphism Xy ,..., X n Y. This just 
means that two wiring diagrams are considered to be the same morphism in S if the only difference 
between them is a renaming of cables. 
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Figure 6. Here is a picture of 0: (X±,X 2 , X 3 ) —*■ Y. The codomain 
of 0 is the outer star Y = {a, b, c, d, ej and the n = 3 domain objects 
are the inner stars Xi = {r,s,t},X 2 = {u,v}, and X 3 = {w,x,y,z}. 
The morphism <j> has cables C = {1,2,3,4,5,6}, and our picture 
shows, for example, that /i(s) = f 3 (w) = g(a) = 1, i.e. that wires 
s,w, and a are soldered onto cable 1. 


made. This is captured mathematically by the pushout in (7) and is drawn below. 

( 8 ) 



0’ O (0.,, 0 2 , 0 3 ) 
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The identity and associativity law hold by the usual properties of pushouts. 

The idea of this paper is to show several applications of the singly-typed wiring 
diagrams operad as well as a variant, the typed wiring diagrams operad, discussed in 
Section 4. First we must explain the notion of algebras on an operad. 

2.2. Operad functors and algebras on an operad. An algebra on an operad is 
a special case of a functor between operads. 

Definition 2.2.1. Let O and O' be operads. An operad functor (or simply func¬ 
tor) F from O to O', denoted F: O —> O', consists of some constituents (A. map 
on objects, B. map on morphisms) conforming to some laws (1. identity law, 2. 
composition law). The required constituents for F are as follows: 

A. There is a function Ob(F): Ob(0) Ob(O')- 

B. For each object y e Ob(0), finite set n e Ob(Fin), and n-indexed set of 
objects x: n —* 0b(0), there is a function 

F n : O n {x;y)^0' n (Fx-,Fy). 

As in B. above, we often denote Ob (F), and also each F n , simply by F. The laws 
that govern these constituents are as follows: 

1. For each object x e Ob(0), the equation F(id x ) = idj% holds. 

2. Let s: m — * n be a morphism in Fin. Let z e Ob(O) be an object, let 
y: n —*■ Ob(0) be an n-indexed set of objects, and let x: to —> Ob(0) be 
an m-indexed set of objects. Then, with notation as in Definition 2.1.2, the 
following diagram of sets commutes: 

(9) O n (y, z) x n fe „ O mi { Xi -, y(i)) — 0' n (Fy ; Fz) x U ien Fy(i)) 


O m (x; z) ---► 0' m (Fx-, Fz) 

We denote the category of operads and operad functors by Oprd. 

Warning 2.2.2. What we call operad functors are usually called operad morphisms or 
morphisms of operads (see [Lei, Chapter 2]). We found that the notion of morphisms 
in an operad and that of morphisms of operads were too easily confused using this 
terminology. The confusion seems analogous to what would arise if we dismissed 
the term “functor” altogether from category theory, relying on the term “category 
morphism” or “morphism of categories” to take over and fulfill its role. 

Example 2.2.3. Suppose that S and T are categories with all finite products. By 
Example 2.1.5 we have operads Ss and Tb. If /: S —» T is a functor that preserves 
finite products then there is an induced operad functor F: Ss —» Ts. Indeed, on 
objects we can put F — f since Ob(Ss) = Ob(S) and Ob(Ts) = Ob(T). Every 
morphism <j)\ {x\,..., x n \ y) in S is given by a morphism (j>: x\ x ■ ■ • x x n —» y in S, 
so we put 

nt) ■ n*i) X • • • x F(x n ) 2 F( Xl x • • • x x n ) F(y ). 

Lemma 2.2.4. Let O he an operad, and let £ he the commutative operad from Ex¬ 
ample 2.1.6. Then there is a unique operad functor O —> £. In other words, £ is a 
terminal object in Oprd. 

Proof. The operad £ has one object and one morphism in each Horn-set, so the proof 
is straightforward. □ 
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Definition 2.2.5. Let O be an operad. An algebra on O is an operad functor 
R: O —> Sets. 

Given two algebras R,S: O —► Sets, an algebra morphism p from R to S, denoted 
p: R —> S, consists of one constituent (A. components) and one law (1. naturality) 
as follows. 

A. For each object x e Ob(O) there is a function p x : R{x) —*■ S(x). 

The law that governs the components is as follows: 

1. Suppose given an object y e Ob(0), a finite set n e Ob(Fin), an n-indexed 
set of objects x: n —» Ob(0), and a morphism <j)\ x —* y. Then the following 
diagram of sets (the so-called naturality square ) commutes: 

ru s(xi) 

n W \ U« 

R(yp - ^s(y ). 

The algebras on O and their morphisms form a category, which we denote by 
0-Alg. 

Remark 2.2.6. Definition 2.2.5 defines algebra morphisms, but it could easily be 
modified to define operad natural transformations between arbitrary operad func¬ 
tors F,G: O —» O'. Operad natural transformations a: F —* G are defined in the 
usual way: a component a x for each object x e Ob(0) and naturality squares for 
each morphism in O. We will not explicitly give the definition in this paper, but it 
straightforwardly generalizes Definition 2.2.5, in which O' = Sets. 

Example 2.2.7. Let £ be the commutative operad of Example 2.1.6. An £-algebra 
S: £ —» Sets consists of a set M e Ob(Set), and for each natural number n e N a 
morphism g n : M n —» M. It is not hard to see that, together the morphism /i 2 : M x 
M —► M and the element go: {*} —» M give M the structure of a commutative 
monoid. Indeed, the associativity and unit axioms are encoded in the axioms for 
operads and their morphisms. The commutativity of multiplication arises by applying 
the commutative diagram (9) to the symmetric group action as discussed in Remark 
2.1.3. 

Lemma 2.2.8. Let O be an operad. The category 0-Alg has all limits and colimits. 
In particular the initial object sends each x e Ob((9) to the empty set, and a terminal 
object (denoted 1*}°: O —<• Sets) sends each x 6 Ob(0) to a singleton set. 

Proof. Limits and colimits of 0-algebras are formed object-wise on O. 

□ 

The following lemma allows us to transfer algebras on one operad to algebras on 
another. 

Lemma 2.2.9. Suppose that F: O^O' is an operad functor. It induces a functor 
F*: O'-Alg —» 0-Alg, sending an O'-algebra i: O' —» Sets to its composition with 
F. This functor has a left adjoint, 

F \: 0-Alg < ±: O' Alg :F* 

Sketch of proof. The functor F* : O'-Alg —> 0-Alg is clear. The existence of a left 
adjoint (also known as a left Kan extension) is well-known, but hard to find in the 
literature. (See [Lur] for a co-categorical version.) The construction of the operadic 
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left Kan extension F\ proceeds analogously to the construction of left Kan extensions 
in basic category theory. Because we will not use the left adjoint in the current paper, 
we leave its existence unproven. 


In this paper we are most concerned with wiring diagrams, and Example 2.2.10 
discusses the algebra of relations on the singly-typed wiring diagrams operad 5. 

Example 2.2.10 (Main Algebra Example). Let S be the singly-typed wiring dia¬ 
gram operad discussed in Example 2.1.7, and fix a set A e Ob(Set). In this example 
we associate to A an 5-algebra 7Zel a- We call it the relational S-algebra of type A. 

To specify this 5-algebra, i.e. this operad functor 7Zel a '■ 5 —► Sets, we need to 
specify it on objects and on morphisms. Let X e 0b(5) = Ob(Fin) be a singly-typed 
star; we assign 

(10) Hel A (X) ■= {R c A x } = P(A*). 


That is, IZelA(X) is the set of |Aj-ary relations on A. For any set A, if X = 0 then 
TZel a(X) = P({*}) has two elements and can be considered to be boolean valued. 


Now suppose that 0: Xi ,.. 

., X n 

—» Y is a singly-typed wiring diagram given by 

the cospan to the left below 




Y 

A Y 


1 * 

\ A ° 

Ai n • ■ ■ n X n ^ C?. 

A x t u.~ux n JjL-. A c 


Note that it induces the diagram to the right above. We need to specify a function 

ftel A (0): ftefy(Wi) x ■ • ■ x TZA A {X n ) llel A {Y). 

So suppose given relations R\ c A Xl ,R n c A Xn . Then 7Zel a( ip)(R A •..., R„) is 
the relation S S A Y defined by first forming the pullback Q in the diagram below, 



and then taking as S the image of Q under the induced function Q — > A Y . We refer 
to R,e\A{4>){Ri, ■ ■ ■, R n ) as the conjunction of relations ify,..., R n . 

Because epi-mono factorizations in Set are unique up to isomorphism, it is easy 
to show that, as specified, IZelA respects the composition formula (7) in 5. 

Example 2.2.11. In the context of digital circuits, it is well known that one can begin 
with NAND gates and put them together to build NOT gates, AND gates, OR gates, 
etc. A NAND gate is an element of 77el{7> ue .p a ; se } ({A,B,out}), namely the relation 
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represented by the table 


NAND 

A 

B 

out 

True 

True 

False 

True 

False 

True 

False 

True 

True 

False 

False 

True 



The wiring diagram <j> given by the cospan {A,B,out} {in,out} •&- {in,out}, where 
/(A) = /(B) = in, is depicted by the form of the diagram below. (The interior is 
“grayed out” for aesthetic reasons, to invoke the idea of viewing NOT as a black box.) 



Note however that this diagram depicts more than a morphism <f>: {A,B,out} —* 
{in,out} in S, but also its application to NAND. That is, it is a depiction of 

NOT : = lZel{True, False} {4>) (NAND), 

as an element of 7?.el{ Tr „ eiFo ; se }({in,out}). One can form relations AND, OR, etc., 
similarly, and then move on to so-called half adders, full adders, n-bit adders, etc. 

At each point the operad allows us to hide the inner implementation details if 
we choose, or use the composition formula to show the whole picture. We can also 
regroup different parts of the circuit, and the associative law of operads assures us 
that this will not change the result. 


Example 2.2.12. In this example we return to the three queries from the introduction; 
see (2). The wiring diagrams for these all involve a three-wire star {X, Y, Z}, and the 
first diagram also involves a one-wire star {Zj. 



{X,Y,Z}U{Z} 


{XY, z } 
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These wiring diagrams are actually morphisms 4>\.<p’2, 03 represented by the three 
cospans above. 4 

For example, we consider <j>\: {B \, B 2 ) —> C , where B\ = {X , Y, Z). B 2 = {Z}, and 
C = {X, Y}. The relations i?i e 72el N (.B 1 ) and R 2 e 72el N (P 2 ) are defined by 

Pi = {(X, Y, Z) e N 3 | X * Y = Z} and R 2 = {Z e N | X = 9}. 

We apply Diagram (11) to our case 

N {XF} 


N {X,F,Z} x N {Z} _ N {A,V,Z} 


R 1 x R 2 ^ - P 

where P = {(X, 7, Z) e N 3 | X *Y = Z and Z = 9}. The cb-conjunction of R\ and 
R 2 is the image of the function P —> namely 

72eli>j(0)(Pi, P2) = {(X, Y) e N 2 | X*T = 9}, 

as desired. 

All of these (0i, <j) 2 , and 03) can be thought of as conjunctive queries in which the 
domain is N; we will discuss this further in Section 4.2. 

Remark 2.2.13. The 5-algebra 72.el,4 has somewhat counter-intuitive behavior when 
it comes to inputting empty relations into a wiring diagram. Given a morphism 
0: Xi,..., X„ —► Y in S, we can apply the function 72el4(c6) to any n-tuple 

((R! C ...,(R n ^ A Xn )) e 72eU(X!) x • • • x 72eU(X n ) 

of relations and return a relation (S c A Y ) e 7Zel a(Y). The strangeness is that if 
any of the Ri are empty, then the ^-conjunction will also be empty, even if there is 
no connection between any wire of X, and a wire of Y. 

There are other algebras, related to 72-el, having different behavior with respect 
to empty relations. The most intuitive or useful one may be something other than 
72el, but we decided for clarity to focus on 72el because its construction (see Example 
2.2.10) is as straightforward as possible. 

Application 2.2.14. The relational 5-algebra might be useful in machine learning 
applications. A goal there could be phrased as follows. Suppose that R c A v 
is a known |F|-ary relation that we are trying to investigate. An explanation of 
the phenomenon R could be cast as a morphism (f) : Xi, • • • , X/. —► Y and relations 
Pi c A Xl through P*, c A Xk such that 5(0) (Pi,..., Pfc) = R. We can search through 
the space of ways to “wire up” known relations to produce the desired relation. 

A similar idea should be prevalent as a basic constituent of any design process. 
The object to be designed is understood as a relationship between its various aspects, 
and we want to produce it using existing objects, each of which is also a relationship 
between its various aspects (see [HK]). In other words, the outer relation must be 
manifest as a wiring diagram of known relations. 


4 In <j >3 the set C is supposed to have two elements (i.e. XY is the name of one element), and 

MX) = MY) = XY- 
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Application 2.2.15. The singly-typed wiring diagram operad 5 and its algebras can 
easily work with time-dependent phenomena. For example, suppose we take A = 
C' 00 (R), the set of smooth functions from R —► R; we speak as though the independent 
variable represents time. Relations on A can model such phenomena as 

• time delay, 

• time-wise addition, subtraction, trigonometric functions, etc., and 

• differential equations and differential relations. 

For example we can represent a 4-second time delay using a relation Delay 4 £ A 2 
where 

Delay 4 = {(/, g) e A x A | Vt e R, /(f) = g(t + 4)}. 

Time-wise addition can be given by the relation {( f,g,h ) e C°°(R) | Vf e R, /(f) +■ 
g(t) = h(t)}. Similarly, differential equations or differential relations such as {(/, g) e 
C°°(R) | Vt e R, A (0,0)}. 

These are just standard relations. The idea here is that wiring diagrams are a 
nice formalism for putting them together. To consider functions of more than one 
variable, one would simply transfer the above ideas to the typed WD operad discussed 
in Section 4. 


3. Brief analysis of relational 5-algebras 

To study the relational 5-algebra TZel a, it would be interesting to find algebraic 
invariants, i.e. algebra morphisms TZAa —» X for some 5-algebras X. In other words, 
suppose we could associate say a complexity level, e.g. a number, to each relation 
in a database in such a way that the complexity levels add when relations are wired 
together. This would provide a useful invariant by which we would know, say, the 
run-time of a query before running it. Unfortunately, it seems that there are very 
few interesting 5-algebra morphisms out of TZel. Example 3.1.1 and Proposition 3.1.2 
explain that there are no interesting additive invariants (“additive” in the sense of 
the operation of commutative monoids) of TZel. 

Example 3.1.1. By Example 2.2.7, there is an operad 5 such that the category of 
commutative monoids is equivalent to the category of 5-algebras. By Lemmas 2.2.9 
and 2.2.4, we can import any 5-algebra to an 5-algebra by pulling back along the 
unique functor t: S — * 5. However, the resulting 5-algebra will not sensitive to the 
precise wiring pattern but only to the number n of inner stars in a wiring diagram 
<f>: X\, ..., x n —> y. Regardless, if CMon is the category of commutative monoids, 
we have a functor 

(12) t* : CMon — 5-Alg. 

What would it mean to give an algebra morphism TZel a —» t*( N), say if N = 
(N, 0, +)? In terms of databases (see Example 2.2.12 and Section 4.2) it would mean 
the following. We would have to assign to every relation a natural number in such a 
way that when a relation Y is written as a conjunctive query on relations X \,..., X n , 
then the number assigned to Y equals the sum of the numbers assigned to the X t . One 
way of doing this would be to assign 0 to every relation, but this is uninteresting. 
Proposition 3.1.2 shows that there generally are no other algebra homomorphisms 
TZe\ A -> N. 

Proposition 3.1.2. Let A be a set with cardinality |A| > 2, and TZel a the A-typed 
relational S-algebra. Let (N, 0, +) denote any commutative monoid and let Af = 
f*(N,0, +) denote the S-algebra that assigns the set N to every singly-typed star X e 


THE OPERAD OF WIRING DIAGRAMS 


0b(5) and summation to morphisms (p in S, as above. The only algebra morphism 
p: TZel a —*■ Af is trivial. 

Proof. We will show that p sends every relation to 0 e TV in four paragraphs corre¬ 
sponding to the following four steps. First we will show this for any complete relation, 
then for any non-empty relation, then for the empty 1-ary relation, and finally for 
the empty relation of any arity. 

Let Y e 0b(5) be any finite set and let K Y e "foel/ifY) denote the complete 
relation ( A Y C A Y ). Consider the morphism cp e Homs (; Y) given by the cospan 
0 —► Y Y. Then the image under TZel a{4>)'- {*} —*■ TZel a(Y) of the unique 
element in the domain is Ky On the other hand, the image under J\f (4>): {*} —► 
AT (Y) = TV of the unique element in the domain is the empty sum 0 e TV. By 
naturality, any algebra morphism p: TZel a —*■ Af must assign p(Y)(Ky) = 0. 

Now let Xi,Y e Ob(iS) be any finite sets, and let (R G A Xl ) be any element of 
TZelA(X{) such that RA0. Consider the morphism ip e Homs(Xi; Y) given by the 
cospan Xi —» X± O Y <— Y. The image irnder TZel a (ip) '■ TZbIa{X i) —* T ieU(Y) of 
R is again Ky, whereas the function Af(ip): N —> TV is the identity. By naturality, 

p(Xi)(R) = 0. 

Now let X 1 = X 2 = Y = {*}, and let a± A «2 e A be two distinct elements. Let 
R\ = {«■!} £ A Xl and let R 2 = { 0 - 2 } £ A X2 . Consider the morphism v: (X -[, X 2 ) —> 
Y given by the cospan {*}ll{*} —► {*} <— {*}. Since R\ and R .2 are nonempty, but 
TZel(v)(Ri,R 2 ) = 0, we have 

p(Y)(0) = + P(X 2 )(R2) = 0 + 0 = 0. 

Finally, let X\ be any finite set, Y = {*}. Let ip: X\ —* Y be given by the cospan 
X\ —* Xi U Y <— Y. If 0 c A Xl is the empty relation then its image under TZel a(tP) 
is 0 6 TZelAfY). As above we have p(X \)(0) = 0. 

□ 

Proposition 3.1.2 shows that commutative monoids, considered as as 5-algebras, 
are not useful invariants of the 5-algebra TZel a- In fact, non-trivial, non-injective 
algebra morphisms out of TZelA seem to be rare, and this provides a nice challenge to 
interested readers—see Conjecture 3.1.6. Example 3.1.3 provides another attempt, 
and Proposition 3.1.4 shows that it fails to be any more informative. However, Ex¬ 
ample 3.1.3 is interesting in its own right. 

Example 3.1.3. In this example, we discuss another 5-algebra in which focal equiva¬ 
lence relations are wired together to form a global one. Given a finite set X e Ob (5), 
let Eq(X) denote the set of equivalence relations on X. We can think of an equiv¬ 
alence relation ~ on X in terms of the surjection X —» X/ ~, and thus depict each 
equivalence relation on X by connecting the appropriate wires internally. Here is a 
picture of an equivalence relation (g ~ h ~ a, b ~ c, d ~ e) on X = {a, b, c, d, e, /, g, h}: 
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Suppose <p: (X t ,..., X n ) —► F is a morphism in S given by the cospan X\ 11 ■ ■ ■ 11 
X n 4 c A- Y. It is easy to see visually how Eq(0 ): Eq{X 1 ) x • • • x Eq(X n ) Eq(Y) 
should act: if two wires are connected through the wiring diagram, then we consider 
them to be connected globally. 



Of course, this can all be done formally. Briefly, given a cospan \f[ i X i G Y 
and surjections X % -» Q, for each i e n, we form the surjection £J i X { -» \\ i Qt, 
push it out along / to give some new set P, factor the composite Y -» C P as 
a surjection followed by an injection, and take the surjective part Y -» C as our 
induced equivalence relation on Y. 

Proposition 3.1.4. Let A e Ob(Set) be a set with cardinality \A\ > 2. Let Eq and 
Pel A be the S-algebras discussed above. The only algebra morphism p: Pel a —» Eq 
is trivial. 

Proof. The trivial equivalence relation Ax: X —* X x X on a set X is the one 
corresponding to the surjection X " lx » X. For any finite set X e 0b(5), consider 
the morphism <j> £ Homs(; X) given by the cospan 0 —> X A-A X. It induces 
an element 7£eU(0)(*) e Pel a(A') and an element Eq((j))(*) e Eq(X), namely the 
complete relation Kx and the trivial equivalence relation Ax, respectively. It follows 
by naturality that under any 5-algebra morphism p: Pel a —» Eq, we have p(Kx ) = 

Ax- 

Let X = 2, and let R <= A x be any relation; we will show that p(R) = Ax- 
For contradiction, assume that p(R) is the only non-trivial equivalence relation on 2, 
namely the one given by the surjection m: 2 —► 1. Let tp: (2,2) — > 2 be the cospan 
{l a , 2 a } U {lft, 2ft} —* {l a , lb, 2 a b} <— {l a , lb} be the wiring diagram as drawn to the 
left below: 



There are two cases. If R / 0 then R = PcIa (ip)(R, K^) and (as seen in the 
right-hand diagram above) we have 

m = p(R) = p(Pel A (iP)(R, K^)) = Eq(^)(p(R),p(K g )) = Af) = A a , 
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a contradiction. If R = 0 we argue as in the proof of Proposition 3.1.2: let aj A 
a-2 e A, let R\ = {(ai,ai)} and R 2 = {(02,02)}- Although both are nonempty, their 
V’-conjunction is empty, so we have that 

TO = p(0) = p(7Zel A (ip)(Ri, R2)) = Eq(tp)(p(R 1 ),p(R 2 )) = £(?(p)(A 2 , A 2 ) = A2, 
again a contradiction. 

Finally, let X e Ob(<S) be any finite set, let R' c dX be any relation, and let 
to' := p(X)(R') e Eq{X) be its image under jr. we want to show that to': X -» Q 
corresponds to the trivial equivalence relation Ax, i.e. that m' is injective. For 
contradiction, assume to' is not injective, and let x\ , x 2 e X be such that m'(x 1 ) = 
to'( x 2 ), and consider the morphism (j>: X —► 2 given by the cospan X — X < Xl ’ x2 
2. Let i? = 7?,el/\((ji)(A') be the induced relation and let m = Eq{<p)(rn r ) be the 
induced equivalence relation. Note that to: 2 —► 1 is nontrivial, and that we have 
p(R) = to, contradicting the work above. 

□ 

It may be that there are no good invariants one can extract from the relational 
<S-algebra. Indeed, after considering the matter for a while we conjecture this to be 
the case. We make this precise using the following definition. 

Definition 3.1.5. Let 0 be an operad and let R: 0 —» Sets be an algebra. We say 
that R is quotient-free if, for any other 0-algebra P and epimorphism /: R —» P, 
either / is an isomorphism or P is isomorphic to the terminal 0-algebra 1*}°. 

Conjecture 3.1.6. Let S be the singly typed wiring diagrams operad, let A e 
Ob(Set) be a set, and let TZAa e Ob(«S-Alg) be the relational algebra of type A. We 
conjecture that IZelA is quotient-free. 

The analysis above is all in the case |A| ^ 2, whereas this is not assumed in 
Conjecture 3.1.6. But one can check easily enough that if |A| < 1 then TZo\a is 
quotient-free (although note the subtlety that occurs for the object 0 e Ob(<S), e.g. 
by (10) we have \Re\ 0 { 0 )\ = 2). 

4. The typed wiring diagrams operad 

The typed wiring diagrams operad is like the untyped version from Example 2.1.7, 
except that each wire and each cable carries a set of possible values, and these sets 
must match for wires or cables that are soldered together. In Section 4.1 we will 
define T and compare it to S. In Sections 4.2 and 5 we will discuss some applications 
of both operads. 

4.1. Definition of typed WD operad. 

Example 4.1.1 (Main Operad Variant). In this example we discuss the operad T 
of typed wiring diagrams. Each object of T consists of a finite set X and a function 
r: X —► Ob(Set), i.e. 

Ob(T) = {(X,r) \ Xe Ob(Fin), r: X — Ob(Set)} s Ob(Set/Fin). 

We refer to each object as a typed star. If X = {aq, x 2 , ■ ■ ■, x n ), we may denote (X, r) 
by 

{%; x 2 : t(x 2 ), ... ,x n : r(x n )}. 

Each x e X is called a wire of X, the set t(x) is called the value type of x, and each 
element v e r( x) is called a value on x. 

We draw an object such as {a: A, b: B, c: C, d: D, e: E} as follows: 
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(13) 


The order of the elements around the circle does not matter: (X, r) is just a set of 
five sets. 

Let ne N be a natural number, and let (Y, v) e Ob(Tj and (Xi, n),..., (X n , r„) e 
Ob(Tj be typed stars. A morphism 

consists of a cospan over Ob(Set), i.e. a finite set C e Ob(Fin), a function er: C —* 
Ob(Set), and functions f,g as below, making the diagram commute: 

(14) Y 




We refer to such a morphism as a typed wiring diagram,-, we refer to the domain 
objects as the inner stars, the codomain object as the outer star, and the set C as 
the set of cables. We similarly follow Example 2.1.7 in terms of both notation and 
depiction, drawing our typed wiring diagrams just like untyped wiring diagrams (5), 
except perhaps including the typing information (compare (4) and (13)). 

Given composable arrows <;7 and (l>-\,, <p n , we can arrange their cospans in the 
form of a W-shaped diagram and form the pushout as in (7). The pushout dutifully 
maps to Ob(Set), so we have the desired composition formula. As in Example 2.1.7, 
the composition formula is intuitive when drawing pictures; see Diagram (8). 

There is a functor U: T —*■ S given by forgetting the labelings on each star. Let 
A e Ob(Set) be a set. There is an operad functor Fa - S —> T given by taking a 
singly-typed star to the typed-star with every wire having type A. The composite 

Sl^T-^S 

is the identity on S. 

Lemma 4.1.2. For any set A e Ob(Set), let Fa - S —> T be the morphism given 
above and let : T-Alg —> <S-Alg be the functor from Lemma 2.2.9, and let lZe\A £ 
iS-Alg be the algebra given in Example 2.2.10. There exists a T-algebra lZe\: T —*■ 
Sets such that for every set A we have an isomorphism of S-algebras 
F%(Ke 1) ss Uel A . 
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Proof. We simply follow Example 2.2.10 in defining the relational T-algebra, Pel: T —» 
Sets. Given a typed star X = (X,r) e Ob(7”), let IIx(t) denote the set 

n x(r) := Yl T ( x )- 

xeX 

We assign Pe\(X) = {R cz IIx(t)}, the set of relations of type X. 

Suppose given a typed wiring diagram (j>: (X\, n), • • • , (X n , t „) —» (Y, v) as in (14) 
and relations _R, e II (t,) for each i e n. Analogous with the singly-typed case (11) 
we form the pullback diagram 



and take as S the image of Q under the induced function Q —► Ily (w). We define 
Tle\{(j)){Ri,...,R n ) :=S 

and refer to it as the (j)-conjunction of R±,.. ., R n . It is easy to see that, under this 
specification, Pel respects the composition formula for T and thus is a T-algebra. 

To see that (Pel) = Pel a is straightforward by construction. 

□ 

4.2. Databases using the typed wiring diagrams operad. The so-called logical 
structure of a relational database can be defined as follows. At the highest level, the 
logical structure consists of a finite set P of predicates, each of which will eventually 
correspond to (i.e. holds the place for) a table. A predicate p consists of a finite set 
of attributes, each of which is a set, i.e. p = (n p , A p ), where n p e Ob(Fin) is a finite 
set and A p : n p —>■ Ob(Set). We sometimes denote p by (A p (l )...., A p (n p )). The set 
n p corresponds to the set of columns of p’s table, and for each column i e n p , the set 
A p (i) is the set of values that can occur in that column. Some relational databases do 
not allow for different data types. In such cases there is a single universe U e Ob(Set) 
and A p (i) = U for each i e n p , 

Given such a logical structure for a relational database, an instance of it consists of 
a relation R p c A p (l) x • • • x A p {n p ) for each predicate p e P. Being in the presence 
of an instance means that the tables we looked forward to above have been filled in 
with data of the appropriate types. 

A query is roughly a question asked of the database. Given a set P of predicates 
as above, a conjunctive query is often written in the following form 
SELECT x\,X2 ,...,Xk 
FROM Pi,P2,---,Pe 

WHERE x h = x' il AND x i2 = x' i2 AND • • • AND x ini = x' im 
Here each xi (and and x) ) refers to a specific attribute in a specific predicate 
Pif->Pe- A conjunctive query can also be thought of as follows. Start with a 
set of relations and take their Cartesian product (using the FROM-clause), then 
choose those rows for which the values in specified pairs of columns agree (using 
the WHERE-clause), and then project down to a subset of the columns (using the 
SELECT-clause). 
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Wiring diagrams (i.e. morphisms in T) give us a way to picture conjunctive queries. 
For example, a predicate p = (n p . A p ) is precisely the same thing as a typed star, i.e. 
an object p e Ob(T). 5 A morphism <j>: ((m, Ai),..., (nr, Ag)) —» (k, x) consists of a 
cospan over Set, i.e. a diagram of the form 


k 



Conjunctive queries are a bit more limited than what can be expressed using wiring 
diagrams. This will be explored a bit in Example 4.2.2. 

Example 4.2.1. Here is an example of a conjunctive query from wikipedia, written in 
the database query language SQL. It uses constants (‘male’ and ‘female’), whereas 
our above description of conjunctive queries does not, but we can still make good 
sense of it with wiring diagrams. 

SELECT L.student, L.address 

FROM attends al, gender gl, attends a2, gender g2, lives L 
WHERE al.student=gl.student AND a2.student=g2.student 
AND L.student=gl.student AND al.course=a2.course 

AND gl.gender=‘male’ AND g2.gender=‘female’ 

Below in (15) we show this query in the form of a wiring diagram. The five black 
inner stars correspond to the five tables in the FROM clause; the two red inner stars 
are the constants; the two wires of the outer star correspond to the two attributes in 
the SELECT clause; and the precise wiring pattern corresponds to the conditions in 
the WHERE clause. 


(15) 



5 In the case of a single universe U, we can make due with the singly-typed wiring diagrams operad 
S and the algebra IZelu . 
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The constants ‘male’ and ‘female’ are each simply considered as a 1-ary relation on 
the set of genders. 

Example 4.2.2. Here we show a non-conjunctive query that can be made using a 
wiring diagram, namely y.3x.R(x) for some unary relation R. The wiring diagram cf 
is represented by the cospan is {a;} {x, y] <&• {y}, 



and the reason it is considered not to be conjunctive is that y is not in the image of 
/• 

Given a relation R e 7?.el({x}), the function 7Zel(c/>): 7Zel({x}) — > TZel{{y\) returns 
(0 £ S) if R = 0 and returns (S c S) if R # 0. (See Remark 2.2.13). That is 
lZel((f))(R) is y.3x.R{x). 

4.3. Disjunctive queries. We can add disjunctive queries to our operadic query 
language by considering IZel as an T-algebra object in JLats, the operad of join 
semi-lattices, rather than in Sets. See Example 2.2.3. To make this precise, we have 
the following proposition. 

Proposition 4.3.1. Let T be the typed wiring diagrams operad, and let IZel: T —*■ 
Sets be the relational T-algebra. Let U: JLats — > Sets be the operad functor 
that sends a join-semilattice to its underlying set. Then there exists a morphism 
JTZel: T —* JLats such that the following diagram of operads commutes: 

T - 7 - el - ^ JLats 



Sets. 


Proof. Given a typed star X := (X, r) e Ob(T), where X e Ob(Fin) and r: X —* 
Ob(Sets), we define the join-semilattice 

J1Zel(X, r) ]^[ t(x)}, with Ri := [J J?j. 

xeX iel iel 

The underlying set U o JlZe\(X, r) is lZel(X, r), so on objects, the triangle commutes. 
We need to say what JlZel does on morphisms (j>: Xi, ..., X n Y in T. 

Given a cospan (X,r) ( C,a ) £- (Y, v), as in Diagram (14), we have a span of 

sets 

X C Y 

The prescription for lZel(<j>) says that for any relation R c | r, we pull it back to 
a relation on \\c a all d then take its image in v. We need only to see that this 
process preserves the join, i.e. union of subsets. But both pullback and image are 
left adjoints; since unions are colimits, they are preserved. 
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Using algebra objects in JLat, as in Proposition 4.3.1, we can take the union of 
any two relations if they have the same type (X,t). Doing so will appropriately 
commute with (^-conjunction. 

5. Closed operads for plug-and-play and recursion 

5.1. Plug-and-play. Hot-plugging, or a variant called plug-and-play, is a computer 
engineering term, which refers to the capacity whereby one or more components of a 
computer system can be replaced without interruption to the system. We use the term 
only slightly differently here, in that we are not considering computers per se but any 
system that can be described solely by a wiring diagram. As such, rebooting is not 
the issue. Instead the issue is to build systems that have slots in which components 
can be filled in later. 

To make sense of this idea, we will use the notion of closed operads. The term 
should be understood in relation to Cartesian closed categories (CCCs), like those 
used as a denotational semantics for computer programs. The similarity between 
CCCs and closed operads is found in the ability to curry a morphism / with multiple 
input types, i.e. to translate / into an equivalent function that has fewer inputs but 
whose output is a function on the remaining inputs. The difference between closed 
operads and CCCs is that closed operads literally have multiple inputs, whereas CCCs 
in some sense simulate having multiple inputs, using Cartesian product. Since Set is 
a Cartesian closed category, the relationship between operads and CCCs is captured 
using algebras on an operad O, i.e. operad functors O —> Sets by which the multiple 
input types of an (9-morphism are translated into the respective Cartesian product. 

The following definitions and terminology follows [Man]. 

Definition 5.1.1. A closed operad, denoted ( O, =>, ev), consists of three constituents 
(A. operad, B. internal Hom-objects, C. evaluation map) conforming to one law (1. 
externalization). The required constituents are as follows: 

A. There is a operad O. 

B. For each object z e Ob((9), finite set n e Ob(Fin), and n-indexed set of 
objects y: n —» Ob((9), there is an object [y => z\ e Ob((9) called the 
internal Hom-object associated to y and z. 

C. For each object z e Ob((9), finite set n e Ob(Fin), and n-indexed set of 
objects y: n — * Ob((9), there is an (n + l)-ary evaluation morphism 

e%z: ([y=>z],y )— 

We may denote the object [y => z] by [(t/i,... ,y n ) =>• z ], when convenient or by 
[y => z\o if necessary. The law that governs these constituents is as follows: 

1. Suppose given an object z e Ob((9), finite sets m, n e Ob(Fin), and so- 
indexed sets of objects x: m —» Ob((9) and y: n —» Ob((9). The function 
extl x ,y; Z : O m (x; [y => z]) —>■ O m+n (x, y; z), 
defined by sending a morphism <p: x — * \y => z] to the composite 
xi ,..., x m , yi,...,y r 0 ’ KW "’ ldy,t > [(t/i,...,y„) => z\,y^...,y n z, 
is bijective. 

The isomorphism extl XiV;z defined above is called the externalization function-, we 
denote its inverse by intl Xt y. z and call it the internalization function. 

A functor between closed operads is just a functor between their underlying oper¬ 
ads, and an algebra on a closed operad is just an algebra on the underlying operad. 
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Remark 5.1.2. The categorically-minded reader may notice that Definition 5.1.1 does 
not explicitly require that the internal Hom-objects [X => Y] be functorial in X or Y. 
However, this functoriality follows from their tight relation to the actual hom-sets, 
0(X\ Y), which are functorial in X and Y by definition. 

Example 5.1.3. The operad Sets of sets is closed. Indeed, given sets Y\,... ,Y n ,Z 
we can define the internal-Hom object [(Yi,. .., Y n ) => Z] e Ob(Sets) to be the set 
Hom Sets (Ti,..., Y n \ Z). 

Proposition 5.1.4. The singly-typed, wiring-diagram operad S (respectively, the typed 
wiring-diagram operad T) is closed. 

Proof. We prove this for S because it is less cluttered, but the proof for T is perfectly 
analogous, adding a map from everything in sight to Ob(Set), as in Example 4.1.1. 

Suppose given finite sets Yi,... , Y n , Z e Ob(<S). We define the associated internal 
Hom-object using the coproduct, 


[(Yi,...,Y n )=>Z] --Y^U' -uYnUZ. 



[Y^Z] 


Figure 16. A picture of [Yi => Z\, where n = 1, Y, = {yi, yi, 3/3}, 
and Z = {zi, Z2, 23, 24,25}. The shape of the picture is meaningless; 
it is merely a suggestive depiction of the set [Yi =► Z] = Yi n Z. 


The evaluation morphism evy-z e <S n +i ([Y Z\, Y; Z) is the following cospan 



where the first function is given by the fold map. Here is a picture of the evaluation 
map in the above case: 
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To see that (S, =>,eu) satisfies the externalization condition, we begin with finite 
sets Xi ,..., X m , Y\.... . Y n , Z e Ob (S) and a morphism cf: X —> [Y =s> Z] given by 
the cospan X C \Y => Z\. We must show that the externalization function 
extlx,Y-,z ■ S rn (X ; [Y => Z]) —► S rn+n (X, Y ; Z) is a bijection, in accordance with 
Definition 5.1.1. By definition, the morphism extlx,Y;z{<t>) '■ (X, Y) —» Z is given by 
forming the following diagram 

Z 


\Y=>Z]uY [Y =► Z] 

-j r I 

f.idv ' * 

XuY C u$06 - 

The bottom-right object is, according to the composition law for S, a pushout; it is 
easy to check set-theoretically that this pushout is isomorphic to C, as written. The 
morphism extlx,Y-,z{<t>) is represented by the cospan X llY —► C <— Z obtained by 
composites. However an easier way to understand what is going on is simply that 
extlx,Y,z converts diagrams like the one on the left below to diagrams like the one 
on the right: 


YUZ 

jffi.S 2 



Z 

92 

XU Y - ^C 

f,9 1 


It is clear that this correspondence ( extlx,Y-,z ) is a bijection, so S is indeed closed. 

□ 


Remark 5.1.5. We will show that in S (with an eye toward its algebra 7£el), one can 
speak of a morphism to the internal Hom-object [(hi,..., Y n ) => Z] as an explanation 
of Z, specifically in terms of Y\.... . Y n . If this is to be the case then when n = 0 
we must have that morphisms to Z = [() => Z] are explanations of Z (in no specific 
terms). This makes sense: a morphism (Xi,..., X n ) —» Z is a wiring diagram, 
which explains the behavior of the outer relation in terms of, i.e. as a query on, the 
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inner relations. Similarly, a morphism X —> \Y => Z\ is the same as a morphism 
(X, Y ) —► Z, so it is an explanation of Z that in particular involves the star Y. 

Definition 5.1.6. Suppose that F: O —* O' is a morphism of closed operads. For 
any object Y e Ob(0), finite set n e Ob(Fin), and n-indexed set of objects X: n —*• 
Ob(0), let evx-Y be the evaluation morphism in O. Applying F we obtain an O'- 
morphism F(evx-Y) '■ (F[X => Y]o,FX) —» FY. Define the closing transformation 
of F to be the O'-morpliism 

(17) F X , Y : F[X => Y\ 0 —« [FX ^ FY] a ,, 

obtained from F(evx-,Y) by applying the internalization function. 

5.2. Recursion. We can think of recursion as what happens when a relation (e.g. 
a function) is “plugged into itself”. The story will go as follows. We use the fact 
that S is a closed operad and define a recursive star to be an object of the form 
[Z => Z] e 0b(5). A recursive setup will be any wiring diagram 0: (X-[,.... X n ) —> 
[Z =► Z\ with output \Z => Z\, and with the input stars filled in with relations 
R\ e 77el(Ai)...., R n e 1Ze\{X n ). Finally, a recursive relation for this setup will be 
any (non-empty) fixed point of the resulting function 

...,Rn ): 'R.el(Z) ^ Tlel(Z). 

The following picture of a recursive setup, for which the factorial function is a fixed 
point, may be helpful. 


(18) 



We will now describe this picture in an example. 

Example 5.2.1. First let us run through the recursive procedure being depicted in 
(18). We are describing a relation, which is supposedly the factorial function, in 
terms of some other relations and itself. The idea is that given a nonzero natural 
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number A, we subtract 1, take the factorial (A — 1)!, multiply this number by A, and 
output the result. If A = 0, output 1. 

The diagram shown above consists of two parts: a morphism <j ): (X-|. X 2 , X 3 ) —> 
[F => F] in 5 and some chosen relations. Here X- t := { A , A'}, X% := {A, B', Cj, X 3 := 
{A,C,BJ, and F := {A,B}. The recursive star is [F => F] = {A,A',B,B'}. The 
morphism <j) is represented by the cospan 

cj)-. {A, A'} II {A, B', C } II {A, C, B} —► {A, A', B, B', C} <— {A, A', B, B'}. 

The chosen relations are written in the boxes. They are: 

Decrement: “ If A > 0 then A! = A — 1 else A' = 0 ” as an element Ri e 
ftelNpfi); 

Multiplication: “ C = A * B' ” as an element i? 2 e F.eli 7 (A 2 ): and 
Conditional: “ If A = 0 then B = 1 else B = C " as an element R 3 e R.e\ii(X 3 ). 
Together these constitute an element {R\,R 2 ,R 3 ) of the left-hand side: 

ftel N (Xr) x ftel N (X 2 ) x Fel N (X 3 ) ftel N ([F =* F]) 

This completes the recursive setup. From it we can form the ^conjunction, 
nel^)(R 1 ,R 2 , R 3 ) e Rel N ([F => F]), 
and applying to it the closing transformation (17), we have a function 
q: Rel N (F) - Fel N (F). 

In terms of the diagram above, q is the function that takes a relation on N x N, plugs 
it into the empty slot, and returns a relation on N x N. A recursive relation for this 
setup is a non-empty fixed point of q. It turns out there is only one: the factorial 
relation, B = A\. 


6. Future work 

There are three main directions for taking this project further. The first is to 
investigate the mathematical properties of the wiring diagrams operad <S (or T) and 
its algebras; this is discussed in Section 6.1. The second is to use the wiring diagrams 
operad and its algebras to study real-world phenomena; this is discussed in Section 
6.2. The third is to change and expand the model, i.e. the operad S itself; this is 
discussed in Section 6.3. 

6.1. Investigating mathematical properties of the WD operad and its alge¬ 
bras. It seems difficult to find any simplifying invariants of relations that are natural 
with respect to wiring diagrams. This was the content of Conjecture 3.1.6. It would 
be quite interesting to know definitively whether such an invariant can exist. It 
would also be good to know whether relational 5-algebras have any privileged place 
in 5-Alg, e.g. whether the algebras 77ely\ can be characterized category-theoretically. 
Many such mathematical questions remain open about relational 5-algebras. 

It is also possible that we could greatly decrease the number of morphisms in each 
hom-set of 5 without having much affect on the category of algebras. For example, 
there is a sub-operad S' <= 5 in which each wiring diagram is required to have exactly 
one connected component, an upshot of which is that all hom-sets in S' are finite. 
We have not yet investigated how the category 5'-Alg compares to 5-Alg. 

The wiring diagrams operad 5 itself has more structure than we have considered 
here. First of all, the objects of 5 are finite sets, but we never discuss how functions 
between them enter the picture. Second, the morphisms <f>: X —» Y in 5 are cospans 
in Fin of the form X —* C <— Y, but we never discuss the fact that there is a whole 


THE OPERAD OF WIRING DIAGRAMS 


category of such morphisms (i.e. we can discuss morphisms of cospans). In other 
words, S can perhaps be lifted to something like an operad object in Cat. 

It would also be useful to investigate whether aggregation, such as taking sums or 
averages in a database, can be understood in terms of the wiring diagrams operad <S 
or T, perhaps using the fact that they are closed. That is, we have a way to speak 
about functions from relations to relations, and aggregation may be phrased in this 
way. 

In that vein, it would be valuable to formalize more of relational database theory, 
including natural keys, normal forms, negation, nulls, queries etc., in the language of 
operads. 

6.2. Using the WD operad and various algebras to study real-world phe¬ 
nomena. One of the most important questions, in the author’s opinion, is how struc¬ 
ture and function are related in the human brain. If the brain is understood as a 
collection of neurons wired together at synapses, then we are tasked with explaining 
how complex functionality like walking and calculating can be housed in such a struc¬ 
ture. The wiring diagrams operad can serve as a language for discussing the structure 
of the brain, in the sense that we need not think of neurons as indivisible objects, nor 
do we need to step from the neuron level directly to the brain level. The brain can 
be divided into different agencies, such as the visual cortex and the auditory cortex, 
and each of these can be broken down further. The WD operad allows us to zoom 
into any given part (either topological region or functional subset) and then connect 
our findings about it with those about other regions. 

Our findings about each region, be it neuron, whole brain, or anything in between, 
might be phrased in terms of algebras over the operad <S. In this paper we used the 
relational 5-algebra, which would be relevant if we think of each portion of the brain 
as managing a relationship between its inputs and outputs. But in general, choosing 
an algebra allows us to do two things. First, we get to assign to each agency of the 
brain a set of possible states, and second, we get to assign a rule by which a state on 
any given whole emerges from the states on its constituent parts. 

Besides using the WD operad to discuss the brain, we may also find it useful in 
understanding the process of design. It seems that intelligent animals can form a 
concept of what they want to see emerge in the world, and then work to create it. 
This requires a constant back-and-forth between what is known and what is intended 
(see [HK]). We build a whole new object with certain properties by putting together 
known objects in creative patterns. The wiring diagrams operad or something re¬ 
lated could be useful to frame the discussion, because it carefully delineates between 
the wiring pattern (operad), and how large-scale function emerges from small-scale 
function via that wiring pattern (algebra). 

6.3. Expanding the model. The wiring diagrams operad in this paper provides a 
simple picture for how smaller entities can be put together to form larger ones, but 
it is certainly not the only operad that would fit such a description. For example, 
a directed version of the wiring diagrams operad with an algebra of functions has 
been shown to exist and a paper on the subject [SS] is in preparation. Directed 
wiring diagrams may be useful in describing processes, or recipes, whereby one process 
(taking inputs to outputs) is made by an ordered sequence of steps (each of which 
involving its own inputs and outputs). 

We may also want to expand the wiring diagrams operad so that the actual spacing 
between inner stars, or the length of the wires, becomes part of the equation, so to 
speak. For example, the classical “little cubes operad” would become a suboperad of 


DAVID I. SPIVAK 


such a topological wiring diagrams operad. The length of wires could encode Shannon- 
style information theory concepts, giving rise to a richer theory. 

In a totally different direction, one could study the mechanical properties of topo¬ 
logical wiring diagrams: if we know how each inner star deforms under stress, and we 
know how the outer star is composed of inner stars, then perhaps we can calculate 
how the outer star will deform under stress. This framework could prove useful to 
materials scientists. 
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